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(57) ABSTRACT 

The method provides for sort independent alpha blending of 
fragments of a graphic image. A sequence of fragments has 
opaque fragments and transparent fragments. The opaque 
fragments are rendered to a frame buffer having at least a z 
buffer, the z buffer having stored therein z values of front 
most opaque fragments. Transparent fragments are stored in 
a list in a transparent fragment buffer. The transparent 
fragments are sequentially read from the list and are dis- 
carded if they are occluded by an opaque fragment. When 
not occluded, the transparent fragments are stored in a list. 
The z buffer is cleared and the transparent fragments are read 
sequentially from the list. Z values are stored in the z buffer 
for back most transparent fragments. The transparent frag- 
ments are again sequentially read from the list. Z values of 
currently read transparent fragments are compared to z 
values in the z buffer of corresponding fragments. If a 
currently read transparent fragment is a back most transpar- 
ent fragment, then it is rendered with alpha blending to the 
frame buffer, otherwise it is again stored in the list. This 
process is repeated beginning with the clearing of the z 
buffer until the list is empty. 

14 Claims, 3 Drawing Sheets 
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METHOD AND SYSTEM FOR SORT 
INDEPENDENT ALPHA BLENDING OF 
GRAPHIC FRAGMENTS 

FIELD OF THE INVENTION 

The invention relates generally to graphics processing in 
a computer system, and more particularly to a method for 
blending graphic fragments, 

BACKGROUND OF THE INVENTION 

Transparency effects are a desirable and necessary part of 
rendering in graphic systems. The difficulty is that correctly 
handling transparency requires processing the polygons that 
contribute to the color of a pixel in a front to back or back 
to front order to determine the color. The transparency of an 
object is usually specified as an "alpha" value which indi- 
cates how much of the color is from this polygon and how 
much should be transmitted from a polygon behind this one. 

When an object is rendered on the screen, an RGB color 
and a Z-buffer depth are associated with each pixel. Another 
component, called alpha, can also be stored. Alpha is a value 
describing the degree of opacity of an object for a given 
pixel. An alpha of 1.0 means the object is opaque and 
entirely covers the pixel's area of interest, 0.0 means the 
pixel is not obscured at all. 

One well known approach to drawing objects with trans- 
parency is to sort the objects and draw them in a back to 
front order. This method can not correctly handle cases 
where polygons inter-penetrate. In each pixel in the screen 
that an polygon covers the current color in the pixel is 
multiplied by (1-the alpha of the polygon), the color of the 
polygon is multiplied by the polygon alpha, and the two 
results are summed and placed into the pixel as the new 
current color. In many applications the cost to sort the 
polygons is unacceptable, frequently due to the large 
number, but increasingly due to the inclusion of geometric 
transformation hardware into the graphics pipeline which 
makes the correct ordering unknown until the primitives are 
transformed. While it might be possible to move the sorting 
into the graphics hardware, this is generally impractical as a 
buffer large enough to hold the polygons would need to be 
provided. 

In addition most 3D graphics systems provide a mecha- 
nism for determining which object elements are visible at 
each pixel. The most common is "z buffering" which 
involves storing a depth (Z) value at each pixel. Initially this 
value is set to the most distant value. When an polygon is 
drawn into the pixel, the depth value is calculated for the 
intersection of the polygon and the pixel. If the calculated 
depth value is behind the depth value stored in the pixel, the 
polygon is not visible in the pixel and its contribution is 
discarded. If instead the image clement depth value is in 
front of the depth value of the pixel then the image elements 
color and z can replace the color and z in the pixel. If the 
objects are opaque the image elements can be rendered in 
any order. If they are not then the transparent image ele- 
ments must be rendered last and sorted back to front. An 
transparent fragment would be correctly occluded if the 
depth value in the fragment is in front of the depth value of 
the transparent image element. If the transparent image 
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element were in front it would be alpha blended with the 
existing color value at the pixel. A third polygon then drawn 
to that pixel that has depth in-between the previously drawn 
opaque polygon and the more recent transparent polygon 
5 could not be drawn correctly. It will fail the z test, the z 
having been updated when the first transparent polygon was 
drawn and the correct color can not be determined without 
knowing the two colors before they were blended into the 
pixels color. 

One simple method for approximating transparency is 
called screen-door transparency. The idea is to render the 
transparent polygon with a checkerboard fill pattern. That is, 
every other pixel of the polygon is rendered, thereby leaving 

15 the object behind it partially visible. Usually the pixels on 
the screen are close enough together that the checkerboard 
pattern itself is not visible. The problem with this technique 
is two fold. First, a transparent object can be only 50% 
transparent with a simple checkerboard. Larger patterns than 

20 a checkerboard are used, but in practice such patterns are 
usually visible. Second, only one transparent object can be 
convincingly rendered on one area of the screen. For 
example, if a transparent red object and transparent green 

25 object are rendered atop a blue object, only two of the three 
colors can appear on the checkerboard pattern. A more 
complex pattern might allow for the occasional correct 
rendering of transparency, but since there is no knowledge 
of what patterns were previously used it is possible that a 

30 pattern would be chosen that would exactly cover a previ- 
ously used pattern for the pixel resulting in an incorrect 
color. However, one advantage of this technique is its 
simplicity. Transparent objects can be rendered at any time, 

35 in any order, and no special hardware (beyond fill pattern 
support) is needed. 

This approach has been further improved in prior art 
systems that support anti-aliasing through supersampling. In 
this case s everal colors represe nj^fiacL-pjjc el, each^ eglor 

40 sample representing a slightly diffej ejaL POsition within the 
pixel, 'ihe primary purpose or'this approach is to handle 
cases where only part of a polygon intersects a pixel. In such 
a case only some of the samples in a pixel are covered by the 

45 polygon. The final color of the pixel is only determined 
when all primitives have been rendered, at which point the 
samples are filtered into one single representative color. The 
screen door approach can be applied on a per sample instead 
of a per pixel basis. This will completely hide the pattern in 

50 the case where the pattern is smaller than the number of 
samples in each pixel. The other drawback of the screen door 
approach — incorrect color in the case of overlapping trans- 
parency remains. 

55 What is necessary for more general and flexible transpar- 
ency effects is the ability to keep track of more than one 
color/z value per pixel. 

A prior art algorithm that is used to increase the sampling 
rate per pixel is Carpenter's A-buffcr and is commonly used 

60 in software for generating high-quality renderings, but at 
non-interactive speeds. The A-Buffer approach also includes 
a improved approach for anti-aliasing but that can be 
ignored when looking at how it implements transparency 

65 that is independent of the order than polygons arc rendered. 
The core of the A buffer approach is maintaining a list in 
each pixel of all of the "fragments" that contribute to it. A 
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fragment is the portion of a polygon that intersects the pixel. The currently read transparent fragment is rendered with 

The process of drawing an polygon includes generating the alpha blending to a frame buffer if the currently read 

fragments for each pixel that the polygon intersect. Geoer- transparent fragment is a back most transparent fragment. If 

ating a fragment usually includes calculation the color, depth the currently read transparent fragment is not a back most 

(Z) and alpha value of the polygon at the pixel. 5 transparent fragment, the currently read transparent frag- 

Each fragment is added to the list at its pixel if it might ment is stored in lhe list. The list is checked to determine if 

contribute to the final color. One option is to assume that all tne lisl * empty. The method repeats the steps of clearing of 

fragments will contribute. The list may be maintained in a tne z buffer to the checking of the list, if the list is not empty, 

depth sorted order. When all of the polygons have been io If the list & em P tv > the process is ended, 

drawn, each pixel is processed. The fragments in the list of The sequence of fragments that are supplied can be a 

the pixel are sorted if they were not maintained sorted. The random sequence of opaque and transparent fragments. The 

fragments are then processed in order, which allows the color buffer and the frame buffer is initially updated with 

correct color to be determined. only color values of the opaque fragments, and thereafter it 

The prior art system used a linked list structure for the per is updated with successive groups of back most transparent 

pixel fragment list. The complexity of implementing a fragments. 

linked list or alternative structures have generally restricted In processing graphical images, it is well known in the art 

the A buffer scheme to non-interactive software implemen- to divide the image into triangles. Position, color, normal 

tations of rendering systems. 20 and texture coordinate commands describe the vertices of 

Thus there is a need for a method of alpha blending the triangle and object coordinates. The processing step of 

fragments that operates efficiently without using linked lists rasterization includes converting the polygons, usually 

or similar structures. triangles, into fragments. This is done to determine which 

pix els in tfte fr ame buffer the polygon intersects and gener- 

BRIEF DESCRIPTION OF THE DRAWINGS 25 ^^tir^Tl^e-nt for each intersccflSnTCbE^ depth and 

The features of the present invention which are believed texture coordinates are assigned to each fragment, calculated 

to be novel, arc set forth with particularity in the appended from information specified with the triangle. The resulting 

claims. The invention, together with further objects and fragments have a pixel coordinate, a value a color, a depth 

advantages, may best be understood by reference to the 30 value and an al P ha value - 

following description taken in connection with the accom- FIG. 1 illustrates a circuit 100 that includes a 3D pipeline 
panying drawings, in the several figures of which like 102 operatively coupled to a frame buffer 104 and a trans- 
reference numerals identify like elements. parent fragment buffer 106. The 3D pipeline 102 preferably 
FIG. 1 depicts a pipeline for processing pixels in a graphic 35 includes a set up engine 108, a raster engine 110, a pixel pipe 
image in accordance with one embodiment of the invention; 112 (forming a first portion), and a render backend block 

/% < i . mi . *u * *u j 114, (forming a second portion). The frame buffer 104 has 

FIG. 2 is a diagram illustrating the operation of a method ' v , . ~ ™ , . 

c . • *• at least a color buffer 116 and a z buffer 118. The color buffer 

of the present invention; , . 

116 stores color information corresponding to pixels in a 

FIG. 3 is a flow chart depicting the steps of the method of 40 display ^ the z buffef m sfc)res z 

the present invention; values for tfae pixels mcluded in lhe disp i ay frame . 

DETAILED DESCRIPTION OF A PREFERRED The 3D pipeline 100 is included in a videographics 

EMBODIMENT OF THE INVENTION integrated circuit that may also include two dimensional 

The present invention is a method and system for sort 45 g ra Phics processing and other processing blocks that may 

independent alpha blending. A sequence of fragments of a affcct thc data storcd within the frame buffcr 104 Such an 

graphic image to be displayed has opaque fragments and integrated circuit is preferably capable of rendering three 

transparent fragments. The opaque fragments are rendered dimensional videographics images for display, 

to a frame buffer having at least a z buffer, the rendering The set up engine 108 produces information based on 

including storing z values in thc z buffer that correspond to 50 graphic primitives 120 that are received by the 3D pipeline 

the front most opaque fragments. Trans parent fragments a re 102. The graphic primitives 120 are triangle primitives, 

store d in a list in a transparent fragment butter, l he trans- which are commonly used in videographics applications, 

parent fragments are then sequentially read from the list. A Slope information corresponding to these primitives is pro- 

currently read transparent fragment is discarded if the cur- 55 vided t0 the raster en & ine 110 > which * operatively con- 

rently read transparent fragment is occluded by an opaque ncctcd to the set up engine 108. Thc raster engine 110 

pixel in the frame buffer. A currently read transparent generates pixel fragments from the primitive slope informa- 

fragmcnt is storcd in the list if thc currently read transparent lion. Preferably, each pixel fragment includes a color value, 

fragment is not occluded by an opaque corresponding pixel a set ot coordinates indicating a pixel in a display frame to 

in the frame buffer. The z buffer in the frame buffer is then 60 which the fragment corresponds, an alpha value indicating 

cleared. The transparent fragments are then sequentially the degree of transparency, and a z value indicating depth, 

read from the list and z values are stored in the z buffer for The raster engine 110 provides the pixel fragments to the 

back most transparent fragments. Thc transparent fragments pixel pipe 112, which is operatively connected to thc raster 

are again sequentially read from the list. A z value of a 65 engine 110. The pixel pipe 112 performs various operations 

currently read transparent fragment is compared to a corre- that may modify the color of the pixel fragment as received 

spondingz value in the z buffer of a corresponding fragment. from the raster engine 110. Such operations can include 
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texture mapping operations. The fragments resulting from 
the operations performed by the pixel pipe 112 arc then 
passed to the render backend block 114 which is operatively 
connected to the frame buffer 104. The render backend block 
114 in general blends fragments with corresponding pixels 
in the frame buffer 104 as determined by the set of coordi- 
nates for each fragment. The z value for each fragment is 
compared with a corresponding currently stored pixel 
z-value and the result is used to blend fragments with 
corresponding pixels. After all resulting pixel information is 
stored in the frame buffer 104, the frame buffer 104 can be 
accessed by display hardware to retrieve pixel information 
for use in generating a display stream for displaying an 
image on a display. 

FIG. 2 depicts in a functional form operation of the 
method of the present invention. FIG. 3 is a flow chart 
depicting the method of the present invention. The method 
of the present invention for sort independent alpha blending 
for producing a graphic image in the frame buffer will be 
described in reference to FIGS. 2 and 3. 

The fragments that are supplied from the pixel pipe 112 
may be opaque or transparent, and are supplied in a random 
order. In order to properly construct the image, it is neces- 
sary that the fragments be alpha blended in a proper order 
with regards to the transparent and opaque fragments and 
with regards to their z values, that is, the depth of the 
fragments relative to one another. 

It is important to note that the method and operation of the 
present invention is independent of the sorting of the primi- 
tives for rendering the graphic image with alpha blending. 
The rendered backend block 114 receives fragments 200, 
which consist of opaque fragments and transparent frag- 
ments in a random sequence. This is depicted in FIG. 2 and 
as a first step 300 in FIG. 3. In FIG. 2 the render backend 
block 114 is illustrated as having a z function logic block 
202 and an alpha blending block 204. Based on the alpha 
values of the fragments 200, opaque fragments are rendered 
to the frame buffer 104, In the frame^uffer 104 the, z buffer 
stor es there in z values oflj' ^ntm^sTopa^u e aentineacE 
Jnxei/ine coi or_Eui """" 



J^I&tQrejL^he^ojoj ^alue ^or^me 
frohtmosTopaque f rajmiejntin eadi_ pixel. J Transparentlrag- 
YmsTTls~are stored in a list in a transparent fragment buffer 
106. See steps 302 and 304 in FIG. 3. This constitutes a first 
pass through the system depicted in FIG. 2, 
'""in a second pass, the render backend block 114 sequen r 
tially reads the transparent fragments from the list in the 
transparent fragment buffer 106. If the currently read trans- 
parent fragment is occluded by an opaque fragment in the 
frame buffer 104, the currently read transparent fragment is 
discarded. The render backend block 114 reads the z values 
from the z buffer 118 in the frame buffer 104. If the currently 
read transparent fragment is not occluded by an opaque 
fragment (based on respective z values) in the frame buffer, 
the currently read fragment is stored again in the list in the 
transparent fragment buffer 106. This constitutes the second 
pass through the system depicted in FIG. 2 and is set forth 
in steps 306, 308 and 310 of FIG. 3. Note that in the second 
pass, no alpha blending occurs and the color buffer is not 
updated. 

In ajjjjrdjsasjs^the z buffer 118 in the frame buffer 104 is 
cleared and the transparent fragments are read from the lust 
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sequentially by the render backend block 114. The values 
ofbaclrmqSt trans parent fr a gmcntsjarc stored linjhe^z buffer 
118 ofMheframe bu ff er 104 (currently reacTz values are 
cbmparedwitfi corresponding initial z values in the z buffer). 
5 The color buffer is not updated. 

In a Jpurthpass, the transparent fragments are again read 
from the Ustintne transparent fragment buffer 106, and z 
values of the currently read transparent fragments are com- 
pared to corresponding z values in the z buffer 118 of the 
frame buffer 104. If a currently read transparent fragment is 
a back most transparent fragment, the currently read trans- 
parent fragment is rendered with alpha blending (block 204) 
to the frame buffer 104, thereby updating the color buffer 
15 116. If the currently read transparent fragment is not a back 
most transparent fragment, then it is stored again in the list 
in the transparent fragment buffer. The list is then checked 
to determine if it is empty. If the list is not empty, then steps 
beginning with the clearing of the z buffer and ending with 
20 the checking of the list is repeated. This procedure is then 
followed until the list is empty at which point the frame 
buffer has been prepared for display. 

It is important to note that the sequence of fragments can 
be a random unsorted sequence of opaque and transparent 
25 fragments. The color buffer 116 in the frame buffer 104 is 
initially updated with only color values of the opaque 
fragments, and thereafter updated with successive groups of 
back most transparent fragments. Thus, the present inven- 
3Q lion effects sort independent alpha blending for generating 
the image in the frame buffer, such that the fragments are in 
proper order. The present invention provides a simplified, 
faster and more efficient approach to processing of graphic 
images as compared to known prior art methods. 
35 It should be understood that the implementation of other 
variations and modifications of the invention in its various 
aspects will be apparent to those of ordinary skill in the art, 
and that the invention is not limited by the specific embodi- 
4Q ments described. It is therefore contemplated to cover by the 
present invention, any and all modifications, variations, or 
equivalents that fall within the spirit and scope of the basic 
underlying principles disclosed and claimed herein. 
What is claimed is: 
45 1. A graphics processing system for sort independent 
alpha blending of fragments, comprising: 

a pipeline having a first portion that receives primitives, 
and outputs an unsorted plurality of opaque and trans- 
parent fragments; 
50 the pipeline having a second portion operatively con- 
nected to the first portion, the second portion receiving 
the opaque and transparent fragments; 
a frame buffer operatively connected to the second portion 
of the pipeline, the frame buffer storing image frame 
55 data; and 

a transparent fragment buffer for temporarily storing the 
transparent fragments during formation of the image 
data in the frame buffer, the transparent fragment buffer 
being operatively connected to the second portion of 
the pipeline. 

2. The graphics processing system according to claim 1, 
wherein the second portion of the pipeline has a z logic 
function stage operatively connected to an alpha blending 
55 stage, each of the z logic function block and the alpha 
.blending stage being operatively connected to the transpar- 
ent fragment buffer and the frame buffer. 
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3. A method of sort independent alpha blending of 
fragments, comprising the steps of: 

providing a sequence of fragments having opaque frag- 
ments and transparent fragments; 

rendering opaque fragments to a frame buffer having at 
least a z buffer, the z buffer having stored therein z 
values of front most opaque fragments; 

storing transparent fragments in a list in a transparent 
fragment buffer; 10 

sequentially reading the transparent fragments from the 
list; 

discarding a currently read transparent fragment, if the 
currently read transparent fragment is occluded by an 
opaque fragment; 15 

clearing the z buffer in the frame buffer; 

sequentially reading the transparent fragments from the 
list; 

storing in the z buffer z values of back most transparent 
fragments; 20 

sequentially reading the transparent fragments from the 
list; 

comparing a z value of a currently read transparent 
fragment to a corresponding z value in the z buffer of 2 $ 
a corresponding fragment; 

rendering with alpha blending the currently read trans- 
parent fragment to the frame buffer, if the currently read 
transparent fragment is a back most transparent frag- 
ment; 30 

storing the currently read transparent fragment in the list, 
if the currently read transparent fragment is not a back 
most transparent fragment; 

checking if the list is empty; 

repeating the method steps beginning with clearing the z 35 
buffer and ending with the checking of the list, if the list 
is not empty; and 

ending, if the list is empty. 

4. The method according to claim 3, wherein the sequence 4Q 
of fragments is a random unsorted sequence of opaque and 
transparent fragments. 

5. The method claim according to claim 3, wherein the 
frame buffer has a color buffer, which is initially updated 
with only color values of the opaque fragments, and there- 45 
after updated with successive groups of back most transpar- 
ent fragments. 

6. The method claim according to claim 3, wherein the 
step of rendering opaque fragments comprises comparing a 
z value of current fragment to a corresponding stored z value 
in the z buffer and replacing the stored z value in the z buffer 
with the z value of the current fragment when the current z 
value is representative of an opaque fragment. 

7. A method of sort independent alpha blending of 55 
fragments, comprising the steps of: 

providing a sequence of fragments; 
in a first pass; 

identifying each fragment as one of an opaque fragment 6Q 

and transparent fragment; 
rendering opaque fragments to a frame buffer having at 

least a z buffer, the z buffer having stored therein z 

values of front most opaque fragments; and 
storing transparent fragments in a list in a transparent g 5 

fragment buffer; 
in a second pass; 



,955 Bl 

8 

sequentially reading the transparent fragments from the 
list; 

comparing a z value of a currently read transparent 
fragment to a corresponding z value in the z buffer of 
a corresponding opaque fragment; 

discarding the currently read fragment, if a result of the 
comparison indicates that the read transparent fragment 
is occluded by the corresponding opaque fragment; 

storing the currently read transparent fragment in the list, 
if a result of the comparison indicates that the read 
transparent fragment is not occluded by the correspond- 
ing opaque fragment; 

in a third pass; 

clearing the z buffer in the frame buffer; 
sequentially reading the transparent fragments from the 
list; 

storing in the z buffer z values of back most transparent 

fragments; 
in a fourth pass; 

sequentially reading the transparent fragments from the 
list; 

comparing a z value of a currently read transparent 
fragment to a corresponding z value in the z buffer of 
a corresponding fragment; 

rendering with alpha blending the currently read trans- 
parent fragment to the frame buffer, if a result of the 
comparison is an equality; 

storing the currently read fragment in the list, if a result 
of the comparison is not an equality; 

checking if the list is empty, repeating passes three and 
four if the list is not empty; and ending if the list is 
empty. 

8. The method according to claim 7, wherein the sequence 
of fragments is a random sequence of opaque and transpar- 
ent fragments. 

9. The method according to claim 8, wherein the frame 
buffer has a color buffer, which is initially updated with 
color values of the opaque fragments, and thereafter updated 
with successive groups of back most transparent fragments. 

10. The method claim according to claim 7, wherein the 
step of rendering opaque fragments comprises comparing a 
z value of current fragment to a corresponding stored z value 
in the z buffer and replacing the stored z value in the z buffer 
with the z value of the current fragment when the current z 
value is representative of an opaque fragment. 

11. A method of sort independent alpha blending of 
fragments, comprising the steps of: 

providing a sequence of fragments; 
in a first pass; 

dividing the fragments into opaque fragments and trans- 
parent fragments; 

rendering opaque fragments to a frame buffer having a 
color buffer and a z buffer, z values of front most 
opaque fragments being stored in the z buffer and color 
values of front most opaque fragments being stored in 
the color buffer; 

storing the transparent fragments in a list in a transparent 
fragment buffer; 

sin a second pass; 

sequentially reading the transparent fragments from the 
list; 

comparing a z value of a currently read transparent 
fragment to a corresponding z value in the z buffer of 
a corresponding opaque fragment; 
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discarding the currently read transparent fragment, if a 
result of the comparison indicates that the read trans- 
parent fragment is occluded by the corresponding 
opaque fragment; 

storing the currently read transparent fragment in the list, 5 
if a result of the comparison indicates that the read 
transparent fragment is not occluded by the correspond- 
ing opaque fragment; 

in a third pass; 

clearing the z buffer in the frame buffer; 
sequentially reading the transparent fragments from the 
list; 

storing in the z buffer z values of back most transparent 

fragments; 15 
in a fourth pass; 

sequentially reading the transparent fragments from the 
list; 

comparing a z value of a currently read transparent 2Q 
fragment to a corresponding z value in the z buffer of 
a corresponding fragment; 

rendering with alpha blending the currently read trans- 
parent fragment to thereby update a corresponding 
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color value in the color buffer of the frame buffer, if a 

result of the comparison in an equality; 
storing the currently read fragment in the list, if a result 

of the comparison is not an equality; 
checking if the list is empty, repeating passes three and 

four if the list is not empty, and ending if the list is 

empty. 

12. The method according to claim 11, wherein the 
sequence of fragments is a random sequence of opaque and 
transparent fragments. 

13. The method according to claim 11, wherein the color 
buffer in the frame buffer is initially updated with only color 
values of the opaque fragments, and thereafter updated with 
successive groups of back most transparent fragments. 

14. The method claim according to claim 11, wherein the 
step of rendering opaque fragments comprises comparing a 
z value of current fragment to a corresponding stored z value 
in the z buffer and replacing the stored z value in the z buffer 
with the z value of the current fragment when the current z 
value is representative of an opaque fragment. 

* * * * * 
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